Data Warehouse and Master Data Management Evolution – a Meta-data-vault Approach
نویسندگان
چکیده
The paper presents a: a) brief overview and analysis of existing approaches to the data warehouse (DW) evolution problem, and b) detailed description of the research idea for the DW evolution problem (primarily intended for structured data sources and realizations with relational database engines). We observe the DW evolution problem as a double issue from the DW perspective, and from the master data management (MDM) perspective. The proposed general solution will include a Data Vault (DV) model based metadata repository that will integrate the DW data and metadata with the MDM data and metadata. This historicized metadata repository will manage schema versions and support schema changes. We believe this integration will: a) increase the quality of data in the Enterprise Data Warehouse (EDW), b) increase the quality of the metadata in the EDW, and c) increase the simplicity and efficiency of the DW and the MDM schema evolution.
منابع مشابه
A Meta Data Vault Approach for Evolutionary Integration of Big Data Sets: Case Study Using the Ncbi Database for Genetic Variation
A data warehouse integrates data from various and heterogeneous data sources and creates a consolidated view of the data that is optimized for reporting and analysis. Today, business and technology are constantly evolving, which directly affects the data sources. New data sources can emerge while some can become unavailable. The DW or the data mart that is based on these data sources needs to r...
متن کاملDesign and Analysis of Quality Information for Data Warehouses
Data warehouses are complex systems that have to deliver highly-aggregated, high quality data from heterogeneous sources to decision makers. Due to the dynamic change in the requirements and the environment, data warehouse system rely on meta databases to control their operation and to aid their evolution. In this paper, we present an approach to assess the quality of the data warehouse via a s...
متن کاملA direct approach to physical Data Vault design
The paper presents a novel agile approach to large scale design of enterprise data warehouses based on a Data Vault model. An original, simple and direct algorithm is defined for the incremental design of physical Data Vault type enterprise data warehouses, using source data meta-model and rules, and used in developing a prototype case tool for Data Vault design. This approach solves primary re...
متن کاملThe Whes Approach to Data Warehouse Evolution El Enfoque Whes En La Evolución De Los Depósitos De Datos
This paper describes the WHES system that enables the creation and evolution of data warehouses. WHES supports a data warehouse evolution model and its associated language MDL. Using a multidimensional approach, this allows one to define and modify the warehouse schema (even in the presence of data) independently of the database model used to implement it. WHES also provides tools to populate t...
متن کاملMetadatenverwaltung zur qualitätsorientierten Informationslogistik in Data-Warehouse-Systemen
The goal of a data warehouse system is to provide a comprehensive overview of the data available in a company, thereby supporting the management decisions. The integration of data coming from heterogeneous sources is one of the key problems in data warehousing. The technical foundations for the integration have been developed in recent years. However, an efficient technical infrastructure is no...
متن کامل